arXiv:1509.04780vl [math.PR] 16 Sep 2015 


A note on the polynomial moments of the partition fnnction 

in the SK model 

Sergey Bocharov 
September 17, 2015 


Abstract 

We prove a simple identity relating the fcth moment of the partition function Zjv(-) in 
the SK model to the Nth moment of the partition function Zk{-)- As a corollary we find a 
characterisation of the limit limjv->oo logEZjv(/3)*^ alternative to the one found previously 
by Michel Talagrand in [^. 


1 Introduction and Main Results 


For the Sherrington-Kirkpatrick model we are given a parameter /3 > 0 referred to as the inverse 
temperature, an integer iV > 2 for the number of ±1 spins, vectors cr = (cti, • • • , ctat) S {—1,1}^ 
representing different configurations of N spins and independent standard normal random vari¬ 
ables gij, I < i < j < N, which describe the interactions between the spins. 

The partition function for the Sherrington-Kirkpatrick model is defined as 

ZnW) ■■= X X 


One interesting problem related to is to study the asymptotic behaviour of its various 

moments as A —>■ oo. In particular the famous Paris! formula proved by M. Talagrand in [7] char¬ 
acterises lim^v-j-oo ;^]Elog Zn{13) as a solution of a certain deterministic optimisation problem. In 
his later paper Talagrand has also given a similar representation of limAr->.oo logIEZjv(/3)“ 
for all a S R, which we shall discuss in Section 4. 

In this paper we shall study EZjv(/3)^, fc S N proving an identity which relates 1KZn{-)^ to 
EZfe(-)^. As a corollary we get a characterisation of limAr->.oo logEZ7v(/3)^ alternative to that 
given in [ 3 . 

Let us now present our main results. Firstly we claim that fcth moments of the partition 
function satisfy the following relation. 

Proposition 1.1. For k > 2 


Or, equivalently, 
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So, for example 


Zn{P) = e''^ ^ cosh (^^^ 512 )) , 

ZpfiP) ^ = e 3 ^"^“ 3 ^" 2 ^E(^(eW(si=+si 3 +s 23 ) ^^(312-313-923) 


+ 0 1^ 


7^(-912-313+323) _|_ g^^(-9l2+9l3-3 ^ 


-923, 


One advantage of identity (HU is that when k is fixed and N —> 00 , Zk{-) on the right hand side 
is a sum of 2 ^ terms and hence the multinomial expansion of Zk{-)^ gives a number of terms, 
which grows like a polynomial in N. This leads to the following result. 

Corollary 1.2. 


lim — log E 

N —^00 1\[ 


ZNiH) 


= max« 

Pc- 


E 

'^£{- 1 . 1 }'= 


_ >. 

Palogpa + ^ PaPa’icr ■ (1.3) 

o-.o-'G!-!,!}*" 


where the maximum is taken over 2^ non-negative real numbers p^ indexed by a G {—1,1}^ such 
that J2aPo- = 1- 

The parameters Per, (t£{— l,l}^in (II.3|) above are most naturally interpreted as a probability 
mass function over { — 1 , 1 }^ and — logPo- as its information entropy (up to a multiplicative 

constant of log 2). So let us define the following notation. 


Definition 1.3. 


• Afe is the set of all the probability mass functions on {—1,1}^. 

Afe := {(p<T)eTG{-i,i}'' : Pa > 0 V CT e {-1,1}'= , Y = l} 

crG{-l.l}'“ 


• The entropy of C G Ak, denoted by £{C), is 

E Ci(T)log2Cia) 

crG{-l.l}'“ 


In view of the above definition equation cu can also be written as 


lim ^logE[zAr(/3)j 

N—^oo J\l L 


max{l„g2£(£) + A£r(^.,^.y} 


CeAk 


(1.4) 


where 1^ • y' is the scalar product of two independent identically-distributed random vectors V 
and V' G (—1, Ij'^ with probability mass function £ and is the expectation with respect to 
randomness over {— 1 , 1 }'=. 

The rest of this article is organised as follows. In Section 2 we discuss some basic properties 
of the maximisation problem (HU-dlll). In Section 3 we prove Proposition 11.11 and Corollary 
11.21 And in Section 4 we show how our results relate to those of Talagrand in . 
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2 Some Discussion 

For shortness let us denote the quantity we wish to maximise in ((Ol) by F{-): 

F'(^(Pa)<TG{-l,l}‘^ j := - X! X! ■ cr'f- 

Firstly, let us observe that the maximisers of F’(-) do not lie on the boundary of the hyperplane 
Afc given by ^{pa)a&{-i,i}’’ G = 0 for some cto € {—(this is not true in the 

degenerate case /3 = oo as we shall see later). 

Proposition 2.1 (Maximisers of F(-) are local maxima). Suppose (pa) G A^ and there exists 
(To G {“1; 1}^ such that Peg = 0. Then there exists {q^) £ A^ such that F(^{qa)) > F'((pct))- 

Proof. Let (pa) £ A^ be such that p^g — 0 for some ctq G {—1,1}^ and let cti £ {—1,1}^ be such 
that Pcri > 0. 

For a small e (e < Pa-i) define qa-g '■= e, q^g '■= Pag — e and q^ := Pa for all a ao, ai. Then 

F{{da)) -F((p<t)) =-eloge + 0(e) 

and thus for e sufficiently small F(^{qc,)) — F(^{pcr)) >0. □ 

Thus any maximiser of F{-) must lie inside the hyperplane Afc and in principle can be found 
using the method of Lagrangian multipliers. 

Proposition 2.2 (Symmetry of the maximiser). Let {pa-)a^{-i,i}k be a maximiser of F{■). Then 
Pa- = p-a for all a £ {-1,1}'". 

Proof. Suppose that there exists a maximiser of F(-) such that Pag ^ P-a-g for some ctq £ 
{-1,1}'=. Define qa := Po- for all a ±cto, qag := q-ag '■= {.Pag + P-ag)!^- 

It is easy to check that to maximise —a log a —b log b subject to a, 6>0, a + 6= c one needs 
to take a = b = c/2 . So 

-qag log 9,^0 - q-ag \ogq-ag > -Pag ^OgPag - P-ag ^OgP-ag 


and therefore 


FiiPa)) = 

- X! P<^^°SPa 

- Pag logPao - P-<yo log P-(TO 


(T^±(To 



4 

+ [^(p^o +P-^o) + (P'^o +P--7gfk^ 




(T^zLcto 

= 


Qa log qa 

- Pag ^OgPag - P-ag ^OgP-ag 


(T^±(To 




qaqa'{(T ■ (j'f +[^{qag+q-ag) (cr • CTq)^] + (q^o + <?-(To 



cT,(T'7^±cro 

<7^:k(To 

< 


Qa log qa 

- qag logg(T0 - q-<T0 log<?-(T0 


(T^±(To 




^ qaqa'i<y +[2{qag+q-ag) ^ qa{cr-cro)‘^] +{qag+q-ag)‘^k‘^ 


tT.tT^T^ihcro a^zkcTo 


=F{{qa)) 

which contradicts the maximising property of {Pa)a£{-i,i}’^ ■ 
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It is natural to look at F{C) as a weighted sum of the entropy of £ and the expected value 
of the squared scalar product of two independent vectors with p.m.f. £. Then it is easy to find 
the maximisers of F{-) in the two extreme cases when /3 = 0 and when /3 —>■ oo. 

In the hrst case 


lim — log E 

N—yoo N 


ZNiO) 


1 k 


log 2 


max £(£) = log 2 k, 


since the entropy is known to be uniquely maximised by the uniform distribution (that is, £(cr) = 
2-'= Va). 

In the second case 


lim — log E 

N—¥00 N 


Zn{P) 


1 k 


/32 

— max 
4 



as /3 —>■ oo. 


Then since \V ■ V'\ < k with equality if and only ii V = ±1^' it follows that E^{V ■ V)'^ < 
with equality if and only if £ is concentrated on zLao for any erg G {~lj 1}^- So 


lim — log E 

V—>-oo N 


Zn{P) 


1 k 


/32 

— max 
4 ceAk 




as /3 —>■ 00 , 


where the maximising p.m.f.’s satisfy £(cro) + £(—erg) = 1 for any erg G {—1,1}* and of these 
p.m.f.’s, for the maximisers of F{-), we would prefer the ones with £((Tg) = £(—ug) = ^ because 
of Proposition 12.21 

Thus as /? varies from 0 to oo we would expect the £'(-)-maximising p.m.f.’s to vary from 
the uniform distribution (lying in the middle of the hyperplane A^) to the p.m.f.’s satisfying 
£(crg) = £(— tTg) = ^ for a (Tg G {—1,1}^ (which lie on the boundary of A^). Or, in other 
words, we expect the F(-)-maximising p.m.f.’s to vary from completely dispersed at /3 = 0 to 
concentrated at ±crg at /3 = oo. 

This seems to make some physical sense since at infinite temperature (/3 = 0) the entropy 
of a physical system is at its maximum, while at 0 temperature (/3 = oo) the system is frozen. 
However the exact physical interpretation of the p.m.f.’s {P(T)ae{-i,i}^ ^ is not clear to us. 


3 Proofs 


In this section we present the proofs of Proposition II. II and Corollary 1 1.21 
Proof of Proposition II.II We have that 


E 


Zn{I3) 


1 k 


= E 






y/N 


I ^k ^k 

+ a, 


l<z<j<iV 


H exp 


/II 

i 2 Ar 


I ^k ^k 
+ a, (Jj 


l<2<J<iV 




where cr^, • • •, are independent copies of a and we have taken the expectation of a log-normal 
random variable. Then expanding the square and swapping the order of summation gives the 
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following identity: 


H KV] + --- + afa^^)2 = ^ (fc + 2 ^ 

l<u<,v<k 

( \ ^ \ ^ ^U^V^U^V] 

2 ^ 2^ ^3 ^3 ) 


l<i<j<N 


l<i<j<N 






= tW^ + (_ Y, [K-; 

l<iu<.v<.k 




f-iv]) 


jN{N-l) ^^k{k-l) ^ ^ (_u_v , , _u _v \i 

— k - N ^ h 2_^ \^i^i +'" + ^n^n) 

IKuKvKk 

E l I I ^2 

(CTi (Ti H- V cr^ajy) . 


2 "2 
kN^ Nk^ 


l<n<'U</c 


Therefore 


E 


Zn^ 


J2 


Q^kN 

= Q 4 4 


0^kN I3^k^ 
— 64 4 


l<i<j<N 

/32 


H exp 

0 - 1 ,■■■ ,(t'“G{- 1 , 1 }'^ 

E 

0-1 ,••• ,o’w6{-l,l}'' 


{|v E W-J 

1 <U< 1 !</l 

E(exp|^ El + ■■■ + 


>1 




• • • + cTj^aj^ 


l<u<.v<k 


= e 4 4 E 




AT 


where cri, • • • , ctat G { — 1,1}^ can be thought of as the rows of the N x k matrix whose columns 
are cr^, • • • , cr^ and are independent standard normal random variables. □ 


Recall that Corollary 11.21 stated that 


lim — log E 
N—¥(x> N 


Zn{i3) =max|- ^ p^logp^T^ ^ p^p<^/(cr • cr')^}) 

crG{-l,l}'' cr,a-'G{-l,l}'' 


where the maximum is taken over 2^ non-negative real numbers Pa indexed by ct G {—1 ,1}^ such 
that Y,^Pa- = 1. 

Proof of Corollary \1.‘A In this proof we shall only work with the space {—1,1}^ and we shall 
use the following simplified notation to make formulae more compact: 

• Ea and will stand for the sum and the product over all a G {—1,1}^- Likewise 
will stand for the sum over all a, u' G {—1,1}^. 

• Ei<j stand for the sum over all i, j G N such that \ <i < f <k. 

• y^. and max, will stand for the sum and the maximum over all combinations of non- 

negative integers fc, <J G { — 1,1}^ satisfying EcrG{-i i}*^ ~ ^■ 
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• maxp^ will stand for the maximum over all combinations of non-negative reals Pu, u G 
{-1,1}'= satisfying P'^ = 

Starting with (ED and applying the multinomial expansion to Zk{ )^ we get 


E 


Zn{P) 


-[ k 


Z^N- 

13‘^k^ 

= e 4 

4 

_ ^e^N- 



4 

Z^N- 

0^k^ 

= 

4 


■HHn) 


N 


i<j 


[ E n =p E 9 . 1 }] ■ 

ia ^ ^ i<j 


where the first summation in the last line is over all the combinations of non-negative integers 
ia, cr G { — 1,1}'= such that X]cre{-i i}*’ *<’’ “ Then moving the product into the exponential 
and taking the expectation (of a log-normal) gives 


e ^ 


=e * 


=e 


-N-i 


-N-i 


■N-i 


*cr 

r A^! r (3 

‘ i^iEnrTj^plTfEsiE'-p.pi) 


E 


. n. 

TV! 


exp 


i<j a 


Thus we have shown so far that 

TV! 
E 


zm \ =E 

*cr 

Let us now prove that 




7,-1 


exp • 


2TV 


4-^- 4 




i<j a 


(3.1) 


lim — logE 
N—^oo N 


ZnW) 


1 k 


= max \ — 

p- 


{ - '^Palogpcr + ^ + tE(E 


i<j a 


(3.2) 


where the maximum is taken over all vectors iPa-)iy£{-i,i}’<‘ with non-negative real entries such 
that E.tg{-i.i}'=P<^ = 1- 

To deal with the multinomial coefficient in (13.11) we are going to use the following well-known 
form of Stirling’s approximation: 

n"+i/2e-" < n! < e n^+^/^g-n ^ ^3 3 ^ 

Let us begin with proving the upper bound of (13.211 . Observe that the summation in (13.111 
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has terms and thus 
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Zn{I3) 


k /TV+ 2'=-! 
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2 '= - 1 


\ r m 
max =——- exp \ ——N 


/3_^ ^ 

4 2N 


i<j a 


(TV+ 2'=)^" max I 


e iV-^+^/^e ^ f P'^k P'^k'^ 
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a:ia>0 


.i^ + 1/2 


^ AT 

— exp < - N — 

ifT ^ 4 


£1 

2N 




i<j u 


/ r,fc\2'‘ f 1 1 j-TV'^+^Z^ fP'^k P'^k' 

< (N + 2^) e max < --7- J- max <-^— exp { - N - 

- ^ ^ n ^ ^ tt ii- I 4 4 


a:ia >0 


n,a 


+ }} 

t<j (T 


Since max^^ ( —- - —772 > < 1 we have 

t ner;i^>0 * 0 ^ ' 


E 


z»(«]“ < (« + 2‘)“'e '5^*=^ 


n,>; 
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< (N + 2‘)“-e max { „ f axp { - 
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*<i <’■ 


where maxp^ is taken over all vectors iP(T)cr£{-i,i}'^ with non-negative entries such that 
X]cre{-i i}'‘P(^ ~ 1 ^'^'4 the last inequality follows from substituting ia- = Pa-N- Moving every¬ 
thing inside the exponential gives 


E 


^n{P) < (A^-I-2^)^ e maxexp |A^logiV-I-i log ^ (pcr-^logpa 

+ PaNlogN) + - — + P—J2(^J2pa<J^ajj I 

i<j a 

= {N + 2’^y e inaxexp - '^p^logp^ + ^ + Y X! 

<7 

1 /3^fc^ 'I 

+ 7iog«-—}. 


i<j a 
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Taking the logarithm of the above inequality and dividing it by N gives 


^logE 




(/3) < inax {-'^Palogpa + ^ } 

cr i<cj a 

+ 1 log ((iV + + 1 (i logiV - . 


Taking limsup^_^go gives 


lim sup — log E 

Ar->-oo 


ZN[fi) 


< max ^ — 

Per 




i<3 <r 


We shall now prove the lower bound of (13.21) . Let p*, a G {—1,1}^ be a vector of maximising 
values of 

-^p<,logp^ + ^ + y . 

a i<j a 

Then there exists a sequence of vectors ia{N), N >2 such that i(j{N) = N and 

ta{N) 


N 


■Pa 


as iV —>• 00 Ver S {—1,1} 


^ E.g. one can take iaiN) := lNp*\ for all ct (1, • • • , 1) and ia{N) := N — ■■■ i) v(.^) 

for cr = (I,-- - ,1)^ 

Therefore for any e > 0 there exists N^; such that for all N > N^: 

k , /32 


inax {-Y.P- + — + Y II ( } 


i<j a 


H P- logPa + — + Y H ( H P>^^^ 

a i<j a 


^ ^^Ja{N) , p^k , 0 
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i^iN) n 2 

UiCTi + e. 
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Then from identity dSU and inequality (ESI) we have 


E 


Zn(P) 


> 


Nl 


yexp{—7V-^ + —} 


Ua^AN) 


i<3 


> 


> 


jSfN+l/2^-N 




(P'^k P'^k'^ P"^ v^/v^- /Ar\ 

exp{—iV-^ + —^(^z.YYc 

i<j a 


iV^+ 1/2 
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Moving everything into the exponential gives 
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ZnW) 


n k 


> 




1 


— exp |iV log A^+ ilogA^-^v(A^) logv(A^) 

cr 


13‘^k ^2 


e 2 '=^ 2 ‘ 


+ —N- 
4 4 


-exp|ilogiV- 


i<j a 

N ^ N 4 4 


P'^N 
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Now fix e > 0. Taking the logarithm of the above inequality and dividing it by N gives 


1 r / 1\11 

- logE Zn{P) > - log ( ^TT - rr—r ) H-log N 

N ^ V ^ '^J - N ^\e^ N^ J 2N ^ 


-E 


1 p^e 

N 4 

ia{N)^ i,{N) , P^k , P 


N 


■log 


N 


P^k ^ p^ ia{N) _ 

4 + 2 EiE N 


i<j a 
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i log N — 


1 /32/c2 

g2'^jV2'=-i; 2N ^ N 4 
2 fc , P^ 


^p;iogp; + ^ + y^(^p;tT,tTj) -e yN> 


K. 


i<j a 

Taking lim inf n^oo of the above inequality gives 

^ ®^ - Ep- + ^ + Y E (E p>^^3) 

a i<j <7 

which holds true for all e > 0. Letting e \ 0 gives 


lim inf — log E 
N—>-oo N 


1 k 


Zn{P) >-^p^logp; + ^ + y ^ , 

cr i<j a 


which finishes the proof of (13.21) . 

Finally, Corollary 11.21 follows from (13.2p by the simple observation that 
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PaPa' 


^EE 

i<,j cr,cr' 

= ^P*aP*a'^^^^l^W3 

a,a' i<j 

(cr • a'p — k 


-■Y.p-p-'{ 
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=P^pIpI'(^ ■ - p- 


□ 


9 


























4 Comparison of with the result of M. Talagrand 

In Michel Talagrand considered the p-spin model with the partition function 

/3 ^ 

ZnW)= { IZ jv(p-i)/2 ^ 

o-e{-l,l}'^ P>1 il,---,ip 

where are i.i.d. standard normal random variables and /3p’s are some real numbers 

satisfying J 2 p >2 

We are only interested in the case when = 0 for ^ 2 and ^2 = /?■ In such a setup 


N 


Zn{P)= exp|^ ^ gycricrjj 

<TG{-1,1}« i.i=l 

P N /3 ^ 

= Y + Y ( 5 y+ 5 'i*)CTz<Tj} 

crG{-l,l}N ^i=l ^ . . 


l<i<j<N 


exp{/35ii} E exp I 

cre{-l,l}^ 


^ l<2<j<iV 


(4.1) 


In Theorem 9.4 in Talagrand gives the following result: 


lim -log E 

w-s-oo kN 


Zn{P) 


1 k 


sup I log 2 + i(/3^ - 2j5‘^q) + y log E cosh'" 
cm 11 t 2 k 


<JG[0,1] 


(4.2) 


where Z = A^(0,1). In order to compare this result with our Corollarv lI.2l we should first replace 
Zjv with Zff. From (ED we see that 

^ " ~ hj ^ ” ~ k 

lim — logE Zn{i3) = lim — logE Zn{-\/2I3) 

N—¥oo iV L J N—¥oo iV L 

and hence (03) can be rewritten as 

^fyogE[Zjv(/3)j = 

9G[0,1] 


lim —logEZjv(/3) = sup |fclog2 +-fc(/3^ — 2/3^(7^) + logEcosh'"(/3fygZ) 
i^co N L J „prn 111 4 

- ifc(fc - l)^^g^| 

sup^ ^-k{k-l)^+\ogH{q)-qk + ^kp'^Y 


(4.3) 


9G[0,i 


where H (g) is the quantity which will feature a lot in this section and which satisfies the following 
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identities: 


H{q) ■= ^ g'?(<^-<^o) (for any choice of (To) 

crG{-l,l}'= 

k 

i=0 

= E^e^^ + e-'^^y , where Z = iV(0,1) 

= 2'=Ecosh'=(v^Z). (4.4) 

The function H : [0, oo) —>• R is important and before we proceed any further let us give a list of 
some of its basic properties. 

Proposition 4.1 (Properties of H{q)). 

ft) H{0) = 2^ H'{0) = k2^ 

'UqilT^) ~ ® V (7 G [0,oo) (in other words, H is log-convex) 

(Hi) k = < lim,^oo = k‘^ Vg G [0, oo) 

Proof, ft) Using the first equation of (14.41) 

Hft))= Y. 1 = 

and for any choice of (Tq G { — 1,1}^ 

k 

H'{0)= Y (^-^0)^= 

(tG{- 1,1}*’ crG{-l,l}'= *.j=l 

= k2’^+ 2Y ah<^i X 

i<3 <tG{-1,1}'“ 

= ^2^ 


fti) 


d /g'(g)\ ^ 
dq V H{q) ) 

It is then sufficient to show that H”{q)H{q) 


H"{q)H{q) - H'jq)^ 

H{q)^ 

— H'{q)^ > 0 for all g > 0. Note that from the first 
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equation of (14.41) for an arbitrary tJo G 1}* 


H' 


'{q)H{q) - H'{qf = [^(a • Uo) 

cr a' 

=i:[< 


2gg(o--CTo) 




cr • ao)‘^ - (a ■ aof((7' ■ aof 


^ X! ~ ■ '^o) 

G,a' 

i ^ [(ct • aof - (a' • ao)^] > q. 


:j9(ct.CTo)^+ij(o-''0-o)^ 


(i*j) Note that from the second equation in (14.41) 


lim e-^"m{q) = lim V f ^ = 2 

t —^oo q —>^oo ’ ^ \ 0 I 


q—^oo 


2=0 


and 


lim e-^^m'{q) = lim e-'='« V(2i - kf f= 2k'^. 

q—^oo q—¥oo * ^ \ i / 

2=0 ^ ^ 

Thus hm,_),oo = limq_>oo e-ic4g(‘~J)^ = increasing in q and = fc it 

follows that 




□ 


Now let us continue with Talagrand’s result. Define 

f(q) ;=_fc(fc_l)|_+logiJ(g)-gfc + ifc/3^ 


Equation (ig said that 


lim — log E 

N—^oo ISf 


Zn{P) 


1 k 


sup f{q). 
96[0,4] 


From Proposition 14.II we get 


= Hr -" 


and 


5^ i/'l —) 

/'(y) = -Kk - 1) + ^ - 1) + - A: = 0 


(in fact /'(g) < 0 for all g > H)- 
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o2 

So /(•) is flat at 0 and non-increasing at ^ and hence sup ^ f{q) is attained at a local 


2 —^9e[o,i^] 

maximum of /(•). Let S be the set of all the local extrema of /(•): 


S := 




no) = 0 } 


2k{k - 1)\ H{q) 



(4.5) 


It is always the case that 0 S S' and it seems that in general S has between 1 and 3 elements 
depending on the values of /3 and k. Then 


lim — log E 

N—yoo 


Zn{P) 


sup f{q) 
96[0,^] 


= sup/( 9 ) 
q^S 

= sup I - k{k - 1 )-|^ -I- logiL(q) - qk + \kl3'^\ (4.6) 

gGS 1/5'^ 4 J 

Thus we have rewritten the result of M. Talagrand (14.21) in the form (14.61) which will be more 
suitable for us. 

Let us now look at our result. In Corollary 1 1.2 1 we have shown that 


lim — log E 
N^qo N 


ZNiH) 


= max 

(Po-)eAfc 


{^(b<T))}, 


(4.7) 


where Afe = |(p„)„g{_i_i}fc : > 0 V ct e {-1,1}'= , = l} and 

F{{P^))=- X! P'^logpa + Y ^ PaPa'icr ■ a'f. 

ProDOsition l2. II suggested that the maxima of F(-) are solutions of the corresponding Lagrangian 
equations. The Lagrangian for the maximisation problem (IE3D is given by 

^'((p„), A) := -^p„logp„ + ^'^PaPa'icr ■ a'f -|- A(^p<, - l), 


where A is the Lagrange multiplier. The partial derivatives of A are: 


9^- 

dpoo 


-\ogPaa-l + ^^Pa{a ■ ao)'^+ X Vctq, 

a 


Equating them to 0 gives: 


/3^ 

^OgPao = ^^Pa{(T ■ aoY + X-l V(To, 

G 

Up- = 1 - 

cr 


(4.8) 
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Or, equivalently, 


(4.9) 


Vao, 

where C is the normalising constant. 

We are not sure how one would rigorously solve (14.81) - (14.91) (and whether it is even reasonable 
to look for all the solutions of (|4.8I) - (14.91) 1. Nevertheless we luckily managed to find values of 
(pcr) that solve (14.9|) and that make F{{p„)) match the expression (14.61) given by Talagrand and 
which therefore must be the maximisers of F{-). However we cannot tell whether we have found 
all such values. 

Before we present these values of (p^) let us prove the following useful result. 

Proposition 4.2. 

(^) 

Y, {cJ ■ cT^f = k2'^ VaoG{-l,l}^ 

o-Gf- 1 , 1 }*^ 

(ii) 


CTGf-1,1}'' 


H'jq) - kHjq) 
/c 2 - fc 


(cto ■ 


PHjq) - H'jq) 
k-1 


Vcro,o-i G {-1, 1}'^, Vq G 


(4.10) 


where H{-) is the function defined in (14.41) . 

Proof, (i) From Proposition 03] (i) 


^(a-CTo)^ = i?'( 0 ) = fc 2 '=. 


(ii) Firstly, note that the left and the right hand sides of (14.101) as functions of q have infinite 
radii of convergence about the origin (being just linear combinations of exponentials). Thus, it 
is sufficient to prove that the derivatives of all orders at the origin of both side of (|4.10l) are the 
same. That is, we need to show that 


V- . ^2, ^2n H(-+^H0) - kH(-HO) ^ 

Y {<^-<^0) (ct-cti) =- 


ctG{-1,1}'' 


k'^ — k 
fc 2 £f(")( 0 ) - ij("+i)( 0 ) 

aT^i 


Vao,ai G {-l,lf, Vn>0. (4.11) 


Now, 


^(cr-cro)^(CT-cri)2" 


E E 




••• ::? 2 n —1 

k 


E 


E 


*1 ^*2 \ il i2 „3l . . . „j2n 


CTg ctq trj • • • ar > a ^ a ^ ■ ■ ■ a- 


J2n = l 


The sum • • • crbn jg non-zero only when each element of the set {ii,i 2 ,ji, ■ ■ ■ , J 2 n} 

is equal to exactly an odd number of other elements of this set. E.g., 


*1 = *2 = Jl = j2 , j3 = ■■■ = J2n , il J3 
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Or, 


— Jl 1 ^2 — ^2 ; J3 — ‘ ‘ * — J2n j ^ ^2 5 J3 ; ^2 ^ J3 ■ 


In this case cr'icr^^cr-^^ • • • = 1, = 2^ and agag^a^ 


■ Ui — CTq CTi CTg CT^ 


or 1 depending on whether ii = 12 or not. Thus 

k 




^ ^ \2n 

cr-CTij = 


n,22,jl,-" ,j2n = l 

— C^n(<^0 ■ ^ 1 ) “I" 




for some constants Cn and Z)„ that do not depend on ctq or cti . Letting uo = <71 yields 

^(n+l)( 0 ) = . ^jj) 2 n +2 ^ ^ 

(7 

Summing (14.121) over all cto G {~1) 1}* yields 

/c2'=iLO)(o) = fc2'= ^(cr • cri)2" = k2’^Cn + 2'^Dn. 

cr 

Solving (14.1311 and (I4.14|) for Cn and Il„ gives 


(4.12) 


(4.13) 


(4.14) 


Cn = 


ijO+i) (0) - fciL(") (0) ^ (0) - iL("+!) (0) 


, o„ = 


k‘^-k ’ ” fc - 1 

as required. 

Having proved identity (14.1111 let us now try to solve (14.811 by substituting 


□ 


Pa = 


H{q) 


, a e {-1,1}* 


for g > 0 and an arbitrary of choice ofai G {—1,1}*^, which we guess to be the right form of 
solution. On the left hand side we have 


q{ao ■ cn)^ - log7J(g). 


On the right hand side we have 


P'- 


^qi(T-(Tl) 


yEI-"'")" h(,) 

=^2 -H'{q)-kH{q) 


2H{q) L k'^-k 


- + A-1 
(do ■ (Tlf + 


2 , eH{q) - H'{q) 


k-1 


+ A — 1, 


using Proposition 14.21 The two sides of (14.81) must equal for all ag G (—1,1}*^ and A can take 
any real value. Thus it is necessary that the coefficients in front of (uo ’ o’l)^ are equal and all 

the remaining terms can be absorbed into A. In other words, for solve (14.81) q 

must satisfy 


^2 

lH'iq)-kHiq)l 

^2 

\H'iq) ,1 

2Hiq) 

k^-k 

2k{k — 1) 
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which is exactly the condition satisfied by the values of q in the set 5 in (|4.5D . Now, 


^(( W) J=- 1: W (W)+T i:<- -') 


09(o-o-l) 




H{q) 


H{q) V 77(g) 


<7,(7' 


77(g) 77(g) 


^ (g(a • ai)^ - log 77(g)) 


g'(g) 

i^(g) 


g +log 77(g) 


■E' 


477(g)- 




H'{q)-kH{q). , 2 fc277(g) - 77'(g) 


fc2 - 7 


-(ct • (Tl)^ + 


7-1 


using (14.1011 and the facts that 77(g) = and 77'(g) = ■ cri)^e'^(‘^'‘^i)^ in the last 

equality. Continuing the simplification we further get 




77'(g) 


H{q) 


H{q) 


/3^ r77,(^)m^^^(^)fc^^(g)-i?'(g) 


477(g)2 L 


77'(g) 


g +log 77(g) 


72-7 ' 7-1 

ri^'(g)E27Ehl + 7= 


77(g) ^ 47(7 - 1) L 77(g)2 77(g) 

Then for any g G 5, + k and thus 



f2k{k — 

b 77(g) 

) V /72 


-g + 7^g + log77(g) 
/72 r/27(7-l) 


+ 47ffvTT[(^^^|^'? + ^) ^\ + k)+k 


47(7-1)LV /?■ 

7(7 — 1)2 rr/ \ 

- g2 g - ^g + log^f(g) + 


which maximised over g G S' gives exactly Talagrand’s expression (gH). 


5 Future Research 


It would be interesting to investigate the asymptotic behaviour of EZjv(/3)^^^^ as N ^ 00 , where 
7(7V) grows with TV. That could for example be useful in estimating the exponential moments 
oiZNiP). 

Another direction for future research is to try to generalise (11.31) and (11.411 to all 7 G M (or at 
least to all 7 G M"*"). Then as suggested in [I] we can recover an alternative characterisation of 
the Parisi formula via the following limiting procedure: 


lim f-ElogZiv(/3) = lim f 

Af —>00 TV fe —>0 7 


lim -logEZ^iP)^ 

. N—^oo i\ 
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